Data science skills

Animals and data

Dyr og data is your first foray into learning key data science skills

Why?

1. to help you complete your Animal Science degree
   • efficiently
   • reproducibly
2. to prepare you for your future career
   • in industry
   • in another field
   • in academia
3. to equip you as informed citizens

Dyr og Data

This is a course in applied data science

We’re not trying to turn to into computer scientists or statisticians

We do want you to use data science skills during your education & when you graduate

Course topics

Learning objectives

At the end of the course

Knowledge

• Describe and separate different data types and methods of data storage
• Describe the visualization theory and grammar behind graphics, and apply both in the creation of data visualizations
• Define and explain fundamental statistical concepts, and apply statistical thinking to make evidence-based decisions from data

Skills

• Select and use methods for data handling of different types of data
• Analyze data using descriptive statistics and exploratory data analysis and explain the results
• Create dynamic reports of data, both as a document and as a presentation

Flipped classroom

This course is different

Mostly be working in groups during class time

Outside of class you will:

• watch short lecture videos
• read parts of the course texts
• (later) work on your portfolio

Course texts

Assessments

You will be assessed as passing the course, or not

Oral Examination

Student gives a 5 minute presentation on a randomly selected portfolio project (48 hrs prep)

Followed by 15 minutes of questions on the course syllabus

5 Portfolio projects

We’ll introduce these to you later in the course

Computing Environment

posit.cloud

Sign up for a free account — invites sent out this morning

Contacting us

By direct email:

• gavin@anivet.au.dk (include Dyr og data in subject line)
• mona@anivet.au.dk (include Dyr og data in subject line)

Expect a response within 48 hours (2 working days)

During the week responses usually within 24 hours

If you send an email after 4pm on Friday don’t expect a response until Monday at the earliest

Email to arrange a meeting as needed

Groups

What to bring to class

1. Laptop!

2. Textbook

Breaks

Learning objectives

At the end of this topic you should be able to

• Articulate what data science is

• Understand at a high level the steps involved in doing data science

• Describe the roles and skills of a data scientist

What is data science?

Data science encompasses a set of principles, problem definitions, algorithms, and processes for extracting non-obvious and useful patterns from large data sets

Kelleher & Tierney, pp. 1

Related fields

• Machine learning
• Data mining

Data science is broader, borrowing from these fields and many other

What is data science?

http://drewconway.com/zia/2013/3/26/the-data-science-venn-diagram

Actionable insight

Data science encompasses a set of principles, problem definitions, algorithms, and processes for extracting non-obvious and useful patterns from large data sets

Kelleher & Tierney, pp. 1

Data science outputs are only useful if we or others can make use of them

Insight

Does data science provide us with information that wasn’t obvious?

Actionable

Can we do something useful with the new information?

Example data science problems

Customer segmentation ⟶ clustering

• find groups of individuals exhibiting similar behavior

Association rule mining

• find groups of things that co-occur together
• animals with similar sets of symptoms

Anomaly or outlier detection

• identifying strange or abnormal events; e.g. fraudulent billing, disease, behaviour

Classification ⟶ prediction

• develop models to predict some outcome — missing piece of data
• predict disease from risk factors & test results
• predict disease from a CT scan

Four “A”s of Data Science

1. Data Architecture

2. Data Acquisition

3. Data Analysis

4. Data Archiving

Data Architecture

Provide input on how data need to routed and organized to support the

• analysis,

• visualization, and

• presentation of data

Data Acquisition

How should the data be collected and represented prior to analysis?

Important tasks that need to happen before data can be profitably analyzed are

• representing data

• transforming data

• grouping

• linking

Data Analysis

How can we summarize data?

Use samples of data to make inferences about the larger context or population

Visualize data and analysis outputs in graphs, tables, animations, dashboards

Communicate the results of the analysis

Data Archiving

How should we preserve data that has been collected?

What forms of the data need to be preserved

Difficult to anticipate future uses of data

Data science skills

Domain expertise

Important to learn the application domain

Ethics and regulation

If data are important enough to collect, they’re important enough to affect people’s lives

Data wrangling & databases

Working with data, files, & databases are essential skills

Computer science & HPC

Computer science & HPC provides algorithms & data structures to tackle increasingly large amounts of data

Data Visualization

Know how to present data in forms that are suitable and that aid decision making

Statistics & probability

Statistics is the field of science concerned with making inferences from samples of data drawn from larger populations

Machine learning

An offshoot from statistics (statistical learning) & computer science

Communication

Communicating with end users, data generators, etc is an essential component of any applied science

Need to translate technical language of animal science, computer science, statistics, machine learning to the language used in specific domains

Before Friday’s Class